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A METHOD FOR ESTIMATING THE APPEARANCE OF NOISE HV 

IMAGES 

FIELD OF THE INVENTION 

5 The invention relates generally to the field of digital image 

processing and, more particularly, to a method for estimating the appearance of 
noise in an output image. 

BACKGROUlVD OF THE INVENTION 

10 In designing an imaging system, it is important to be able to 

determine the magnitude of the level of image degradation to be expected in the 
final image as viewed by the observer. Understanding the magnitude of the image 
degradations due to grain is also important to the use of the image reproduction 
system and can have a major impact on the selection of key elements for use in the 
1 5 imaging chain. 

In an imaging system, the variations in otherwise uniform 
responses to exposing light are referred to as noise. In a traditional photographic 
system, these variations in the density can be observed through physical 
measurement by measuring the optical density of photographic materials, such as 

20 film or paper, with a microdensitometer. The root mean square (rms) value or 

standard deviation is used as a measure of the variation in density of an otherwise 
uniform area. This value is referred to as the granularity. An output image is 
perceived by an observer and the perception of these unwanted, random 
fluctuations in optical density are called graininess or noise appearance. Thus, the 

25 physically measured quantity of granularity is perceived by the observer as a level 
of graininess. 

Various efforts have been made to estimate and quantify the 
appearance of noise, or graininess, in an output image. C. Bartleson, in "Predicting 
Graininess from Granularity," J. Phot. Sci., Vol. 33, No. 4, pp. 1 17-126, 1985, 
30 showed that graininess is dependent upon the granularity at a visual print density 
of 0.8. He determined the following relationship between the graininess G, and 
the granularity Ov 



Gi = a* log (av)+b 

where a and b are constants. 

Bartleson's work made it possible to estimate the graininess that a 
given imaging system will produce. Unfortunately, the graininess of different 
5 images produced from a common imaging system can have a huge variation. This 
is because any image transform that is applied to create the output image can alter 
the visibility of noise in a system. For example, a photographic negative can be 
imaged with an enlarger onto photographic paper. However, the noise appearance 
of the output print is highly dependent on the exposure given to the negative. 
10 Thus, the noise appearance of any given output image produced with a given 
imaging system may be quite different than the estimate enabled by Bartleson's 
work. 

In US Patent 5,641,596 issued June 24, 1997, Gray et al. describe a 
method of determining a noise table. Noise tables describe the density dependent 

1 5 noise of a particular image capture device, and therefore quantify the density 

dependent noise of images created by the image capture device. The noise table is 
usually modeled as the output from a specific scanning device and image capture 
device (such as film.) Alternatively the noise table could represent a digital image 
capture, or photographic film. A noise table represents the standard deviation of 

20 noise as a ftinction of mean code value. However, a noise table alone is not a 

good indicator of the visibility of noise in an output image. An imaging system's 
output image is a product of multiple image transforms, each of which modifies its 
noise characteristics. Therefore, a pre-output noise table (such as a noise table 
quantifying the characteristics of an image capture device) does not represent the 

25 noise characteristics of an output image. 

Noise information has been used to modify parameters of a user- 
selected algorithm. Cottrell et al., in US Patent 5,694,484 issued December 2, 
1 997, describe a method of using characteristic information (e.g. Modulation 
Transfer Function and Wiener Power Spectrum to characterize noise) of input and 

30 output devices, calculating an objective metric of image quality, and determining 
the parameters for an image transform (such as sharpening boost) by optimizing 
the objective metric of image quality. Cottrell et al. again make the implicit 



assumption that all output images produced by a common imaging system will 
have a similar appearance of noise. However, this is not the case. While the 
images produced directly from an imaging device may have similar noise and 
sharpness characteristics, these characteristics may be vastly modified by the 
5 image transforms that produce the output image. In addition, for many imaging 
systems, for example, US Patents 6,097,470 and 6,097,471 both issued August 1, 
2000 to Buhr et al., the operation of image transforms vary based on an analysis of 
the image. The effect of image dependent image transforms is not considered by 
Cottrell. 

10 Keyes et al in US Patent 6,091,861, issued July 18, 2000, describe 

a method of determining a sharpening parameter based on the exposure (i.e. the 
SBA balance) of the image. Their method also takes into account the granularity 
of the image and computes an expected graininess value (PGI), which is related to 
the granularity. However, this method does not have the flexibility to take into 

15 account the effects of the application of an image dependent image transform. 

Additionally, summarizing the noise on the print by using the exposure is prone to 
error, since even an image with a normally exposed subject can easily contain 
background areas that contain noise of a vastly different magnitude. 

Another method of determining the noise appearance in a particular 

20 output image is to compare that output image to a set of standard noise examples 
arranged in a ruler. The first grain slide or ruler was designed and fabricated by 
Thomas Maier et al. See for example, T. O. Maier and D. R. Miller, "The 
Relationship Between Graininess and Granularity'* SPSE's 43 Annual Conference 
Proceedings, SPSE, Springfield, Va, 1990, pp. 207-208. C. James Bartleson 

25 determined the fundamental relationship relating the granularity and graininess. 

Maier et al. produced a series of uniform neutral patches of grain at 
the same average density with increasing amounts of grain using a digital 
simulation instrument. They then used microdensitometer measurements and the 
fundamental psychophysical relationship to relate the graininess to the rms 

30 granularity. Cookingham et al. produced improved grain mlers as described in US 
Patents 5,709,972 issued January 20, 1998, and 5,629,769 issued May 13, 1997. 
While such noise rulers do effectively allow for an individual to numerically 



quantify the appearance of noise in an output image, the process is labor intensive 
and requires a human observer to individually evaluate each output image. 

Therefore, there exists a need for an improved noise metric that 
avoids the problems noted above. 

5 

SUMMARY OF THE INVENTION 

The need is met according to the present invention by providing a 

method for estimating the noise appearance in an image, that includes the steps of: 
forming a noise table representing noise magnitude vs. intensity of the image, and 

10 generating a noise metric from the noise table, said noise metric representing the 
noise appearance in the image. 

According to a preferred embodiment of the invention, the step of 
forming a noise table includes the steps of: forming an input noise table 
representing noise magnitude vs. intensity of an input image; providing an image 

1 5 processing chain including one or more image transforms; determining an 

appropriate noise transform defining the effect that each image transform will have 
on the noise in the image; and applying the one or more noise transforms to the 
input noise table to produce the noise table representing an estimate of the noise in 
the image. 

20 

ADVANTAGES 

The present invention has the advantage of automatically and 

quickly providing a noise appearance estimate of an image without the need for an 
operator, or for time consuming computations on the image. The noise 
25 appearance estimate is able to take into account any transforms that are applied to 
the image. The method of the present invention produces a noise metric that is 
highly correlated to noise estimates performed by humans. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 Fig. 1 is a block diagram illustrating an overview of the present 

invention; 



Fig. 2 is a block diagram illustrating the output noise table 
generator of Fig, 1 ; 

Fig. 3A and B illustrates two example weighting functions used in 
generating the noise table; 
5 Fig. 4 is a block diagram illustrating an image processing path that 

is composed of image transforms; 

Fig. 5 is a block diagram of the noise path generator of Fig. 2; 

Fig. 6 is an illustration of the noise table path; 

Fig. 7 is a block diagram of an example image processing path; 
1 0 Fig. 8A illustrates a rendering LUT; 

Fig. 8B illustrates a LUT which models the response of the human 

visual system; 

Fig. 9A-C illustrates several example output images and their 
associated output noise tables; 
1 5 Fig. 10 illustrates an alternative embodiment of the present 

invention 

Fig. 1 1 illustrates an altemative embodiment of the output noise 
table generator of Fig, 10; and 

Fig, 12 illustrates an altemative embodiment of the present 

20 invention. 



DETAILED DESCRIPTION OF THE INVENTION 

In the following description, the present invention will be described 

as a method implemented as a software program. Those skilled in the art will 
25 readily recognize that the equivalent of such software may also be constructed in 
hardware. Because image enhancement algorithms and methods are well known, 
the present description will be directed in particular to algorithm and method steps 
forming part of, or cooperating more directly with, the method in accordance with 
the present invention. Other parts of such algorithms and methods, and hardware 
30 and/or software for producing and otherwise processing the image signals, not 
specifically shown or described herein, may be selected from such materials, 
components and elements known in the art. Given the description as set forth in 



the following specification, all software implementation thereof is conventional 
and within the ordinary skill in such arts. 

It is instructive to note that the present invention can be used to 
describe the noise appearance in either an analog image or a digital image. An 
5 analog image is an image represented in a continuous manner, such as with a 
photographic negative or a photographic positive (slide). A digital image is 
typically a two-dimensional array of red, green, and blue pixel values or of single 
monochrome pixel values corresponding to light intensities. In addition, the 
preferred embodiment is described with reference to an image of 1024 rows of 

10 pixels and 1536 lines of pixels, although those skilled in the art will recognize that 
digital images of different resolutions and dimensions may be used with equal, or 
at least acceptable success. With regard to matters of nomenclature, the value of a 
pixel of a digital image located at coordinates (x,y)y referring to the x^^ row and the 
column of a digital image, shall herein comprise a triad of values [r(x,y), 

1 5 g(x,y), b(x,y)] respectively referring to the values of the red, green, and blue 
digital image channels at location (x,y). In this regard, a digital image may be 
considered as comprising a certain number of digital image channels. In the case 
of a digital image comprising red, green, and blue two-dimensional arrays, the 
image comprises three channels, namely red, green, and blue spectral channels. 

20 Additionally, a luminance channel n may be formed from the color signals. The 
value of a pixel of a digital image channel n located at coordinates (x,y), referring 
to the row and they^ column of the digital image channel, shall herein be a 
single value referred to as n(x,y). In addition, in the case where the image/is an 
analog image, then the value f(x,y) represents a light intensity at a location 

25 indicated by (x,y). 

Referring to Fig. 1, an output noise metric describing the noise 
appearance of an output image is generated according to the present invention by 
generating 2 an output noise table and generating 4 the output noise metric from 
the output noise table. 

30 Typically, an output image is a photographic print. Also, the 

output image could be an image displayed on a CRT monitor, or an image printed 
or displayed onto paper or some other medium. For example, the output image 




may be generated with ink jet printing, any softcopy display, a thermal printing, 
an electrophotographic printing, a laser printing, or by other output means. In this 
regard, the output noise table generator 2 receives as inputs an input noise table 
and an image processing path 10. Additionally, the output noise table generator 2 
5 may receive an optional weighting function and optional accuracy data. These 
inputs will be described in more detail below. 

The output noise table generator 2 outputs an output noise table 
which represents the intensity dependent characteristics of noise on the output 
image. In a preferred embodiment, the output noise table relates to the green 

10 channel of the image, although the output noise table may relate to any spectral 
channel or combination of spectral channels. The output noise table is passed to 
the output noise metric generator 4 which performs an analysis of the output noise 
table to output an output noise metric. 

The output noise metric relates to the appearance of noise in the 

1 5 output image. In the preferred embodiment, a larger value of output noise metric 
indicates an output image with a greater noise appearance. Thus, the relative 
ranking of two or more output images in terms of noise appearance may be 
determined with the output noise metrics calculated for each output image. 

It is important to notice that the present invention has the capability 

20 of determining the noise appearance of the output image without actually 

examining any image. Notice that the present invention uses as inputs, an input 
noise table, an image processing path, and optional weighting function and 
accuracy data. All of these inputs contain information about an image and its 
intended purpose, but themselves are non-image data. Non-image data associated 

25 with an image is often referred to as metadata. Thus, the present invention has the 
capability of determining the noise appearance of an image based solely on 
metadata analysis. Since no image analysis is required, the calculation of an 
output noise metric can occur very quickly on a typical computer. 

Fig. 2 shows a more detailed view of the output noise table 

30 generator 2. A noise table pre-processor 18 utilizes information from the 

weighting function and the accuracy data in order to adjust the noise table. The 
image processing path 10 is input to the noise path generator 16 for the purpose of 



generating a set of noise transforms 30i, that when applied to the noise table by the 
noise path applicator 22 generate an output noise table Nm that corresponds to the 
noise characteristics of an output image passed through the image processing path 
10 

5 The output noise table generator 2 receives an input noise table N. 

A noise table N contains an estimate of the noise expected for the image which 
quantifies the relationship between the image intensities and expected noise 
magnitude for given intensities. The noise table N reports for each intensity z, the 
noise value a(/). Typically, for digital images, the noise value a(/) is given as the 

1 0 standard deviation of the noise in the metric of the code values of the digital 

image. Alternatively, another measure of the expected value of noise (besides the 
standard deviation) may be used. For example, it is common to quantify noise in 
terms of a covariance matrix between multiple spectral channels of an image. 
Also, it is common to quantify the noise magnitude by the noise power spectrum, 

15 or Weiner noise spectrum. In that case, the noise table would contain information 
relating the noise power spectrum for a selection of intensities. 

For example, an input noise table N having 9 rows and four 
columns is shown in Table 1 below. The first column represents intensity and the 
2^"^, 3"^, and 4**^ columns represent the noise standard deviations for the 

20 corresponding intensity i for the red, green, and blue image channels respectively. 
Noise values a(/) for intensities not explicitly contained in the noise table N can 
be determined by interpolation, as is well known in the art. 
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The input noise table contains information related to the noise of an 
image. Generally, a separate input noise table is required to characterize each 
image acquisition devise. For example, for digital images created by scanning 
5 color negative film, each film speed would require a separate input noise table. 
US Patent 5,641,596 previously referenced, describes a process by which an input 
noise table can be created by measuring the standard deviation of pixels from 
scans of regions of uniform exposure on a film. Those skilled in the art of image 
processing will recognize that an input noise table created in such a manner will 

10 then describe the noise characteristics for all images whose source is common to 
the source of the uniform exposures used for measuring noise standard deviations. 

In addition, the output noise table generator 2 may optionally input 
accuracy data which represents the accuracy of the input noise table N for a 
corresponding image. The input noise table can be adjusted in the case that the 

1 5 accuracy data indicates that the input noise table is inaccurate. For example, 
accuracy data can be numerical values indicating the difference A between the 
Dmin (minimum optical density) of an image and the expected Dmin for a particular 
film or image source. The noise table may then be adjusted by the noise table pre- 
processor 18 for the difference by creating a new input noise table consisting of 

20 noise standard deviations an(0 as follows: 

C7n(/) = a(/+A) 

where an(0 are the noise standard deviations of the new noise table. 

An additional operation of the noise table pre-processor 18 is to 
apply a weighting fiinction to the noise table. The weighting function allows for 

25 more importance to be placed on some intensities than others. In the preferred 
embodiment where a noise table N consists of intensities i and corresponding 
noise standard deviations a(z), the weighting function w(z) is a function of 
intensity /. In an alternative embodiment where the noise table N consists of noise 
power spectra, the weighting function may be a function of both intensity and 

30 frequency. The weighting function w(/) is applied by* the noise table pre- 
processor 18 to generate new noise table standard deviations according to the 
following equation: 



^n{i) = w(0 a(/), 

where an(0 are the noise standard deviations of the new noise table. 

Fig. 3A and B show two examples of weighting functions. Fig, 
3A, illustrates a weighting function which emphasizes the noise content in the 
5 midtones of an image. Fig. 3B illustrates a weighting function which emphasizes 
the noise content of the dark portion of an image. In the preferred embodiment, 
the weighting function w(/) is the histogram of the image corresponding to the 
input noise table and the image processing path 10. Those skilled in the art of 
image processing are familiar with image histograms. Note that a weighting 

1 0 function and the accuracy data may both be applied to an input noise table by 
concatenation of the operations by the noise table preprocessor 18 in order to 
create the noise table Nq. Note also that when no weighting function or accuracy 
data is supplied, the noise table pre-processor 18 outputs the noise table No which 
equals the input noise table N. Those skilled in the art will recognize that 

1 5 weighting functions may be applied to a noise table at any time (for instance, 

within the noise path applicator 22). Deviations from the preferred embodiment 
such as moving the position of the weighting function application to the noise 
table should not be considered as novel. 

Fig. 4 shows that the image processing path 10 is composed of 

20 image transforms 1,2, m, .... M. Each image transform 20 (equivalently 
called an image transform step) is applied in order to the input image fo(x,y) in 
order to create the output image fM(^,>'). The application of image transform m to 
the image fm-i(x.y) results in image fm{x,y). Each image transform 20 is an 
operation that is applied to the image. Examples of image transforms include the 

25 application of Look-Up-Tables (LUTs), application of balance shifts, application 
of matrices, application of sharpening or blurring operations, and application of 
the tonal response of photographic paper. While these image transforms are 
typically mathematical operations applied to the pixel values of a digital image, 
the present invention need not be limited to digital imagery. For example, all of 

30 the steps required to expose a photographic negative onto photographic paper can 
be modeled as a series of image transforms 20, An image transform 20 can 
represent a physical step that occurs to an image. For example, an image 
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transform 20 could represent the process of printing an image onto photographic 
paper or an image transform 20 could represent the difference between the 
calibration aim densities and actual achievable densities. In addition, image 
transforms 20 can represent processes preformed by the human visual system 
5 when the output image is viewed. Thus, the present invention is useful in 
estimating the graininess of both digital and analog imaging systems. 

The output noise table generator 2 generates an output noise table 
using the input noise table and the image transforms 20 of the image processing 
path 10. The input noise table itself often has httle correlation with the 

10 appearance of noise on the output image. For example, the appearance of noise in 
a series of images all originating from a single digital scan of a photographic 
negative but having different balance shifts can appear quite different. Often in an 
imaging system, several image transforms are applied to an input image fo(x,y) in 
order to obtain an output image fM(x,y). Each image transform 20 that is applied 

15 to the input image in order to generate the output image affects the visibility of 

noise in the output image. The operation of the output noise table generator 2 is to 
modify the input noise table in an appropriate fashion to take into account the 
effects of the image transforms 20 on the noise in the image, thereby creating an 
output noise table. This modification is executed by the noise path applicator 22 

20 (see Fig. 2) by applying a noise table path, generated by the noise path generator 
16, to the noise table No- 

Referring to Fig. 5, similar to the image transforms 20 of the image 
processing path 10, a noise table path consists of noise transforms 30 applied one 
after another to the noise table No . Each image transform 20m in the image 

25 processing path 10 has a corresponding noise transform 30„i. The noise path 

generator 16 inputs the image processing path. For each image transform 20ni, the 
noise transform generator 40 determines the corresponding noise transform 30m. 

Noise in images can effectively be thought of as instances of a 
random variable. Thus, the effect of each image transform on noise can be 

30 modeled with the principles of functions of random variables, as described for 
example by Papoulus in Probability, Random Variables, and Stochastic 
Processes, McGraw-Hill, Inc., 1965. Thus, the operations of the noise transform 



generator 40 are based on the principles of functions of random variables. For 
each image transform 20ni of an image processing path, a noise transform 30m can 
be made. The process of applying noise transforms 30 to a noise table in order to 
model the effects on noise resulting from the application of image transforms 20 
5 to an image is known as noise propagation. The noise path applicator 22 performs 
noise propagation in order to generate the output noise table. US Serial No. 
09/337,792, filed June 22, 1999 by Bums et al. describes in detail noise 
propagation in imaging systems using noise tables. In addition, the Bums 
application describes the method by which the noise transforms 30 are generated 
10 from the image transforms 20, as shown in Fig. 5. 

For example, if the image transform 20i is the application of a LUT 
to the image, then the image transform 20 1 can be represented mathematically as 
the function gi(n): 

H^^y) ==gi(fo(^,j^)), 

1 5 where foix.y) is an image input to the image transform 20i and fi(x,y) is an image 
output from the image transform 20i . 

Assuming that the image noise is Gaussian and the LUT is locally 
linear, the noise transform generator 40 of the noise path generator 16 would 
create a noise transform 30i corresponding to the image transform 20x such that 
20 the noise table N(a(0, 0 consisting of intensity levels / and noise values 
corresponding to the intensity levels a(i): 

N(a(0,0 

is propagated to create the new noise table Ni: 

Ni(aiOi) , h) = N( giXO MO , gi(0)> 
25 where gi'(0 is an approximation of the slope of the LUT, evaluated at intensity z. 

Approximating the local slope of a LUT is well known to those skilled in the art. 

Fig. 6 illustrates that each image transform 20in has a corresponding noise 

transform 30ni which is applied to the noise table No by the noise path applicator 

22 in order to produce an output noise table Nm- 
30 In a similar manner, the noise table can be propagated through 

noise transforms 30 corresponding to a wide variety of image transforms 20. 

Bums et al. describe in detail, noise propagation for image transforms of LUTs, 



balance shifts, matrices, etc. Note that although in the preferred embodiment, a 
noise transform 30 is created for each image transform 20, it may be possible to 
receive most of the benefits of the present invention as long as the noise 
transforms 30 for the more significant image transforms 20 are determined. In 
5 addition, it is well known in the art of digital image processing as described by 
Cottrell et al. that the effect on noise of application of a spatial filter can be 
modeled by multiplying the noise power spectmm by the magnitude of the filter 
response. 

The output of the noise path applicator 22 is the output noise table 

10 Nm. a separate output noise table can be created for each of the spectral channels 
of an image. Typically, an output noise table Nm is generated for each of the red, 
green, and blue image channels, but a noise table for a single spectral channel 
such as the red, green, blue, or luminance channel can be altematively generated. 

Fig. 7 shows an example image processing path composed of 

15 image transforms designed to create an output image which is a photographic print 
from an input image, which is a digital scan of a photographic negative- 
Examples of such image processing paths are disclosed in US Patents 6,097,470 
and 6,097,471, referenced above. First, an imaging device response is linearized 
42 with an image transform 20 that applies compensation for non-linearities in the 

20 response of the imaging device. A method of correcting for the non-linearities in 
the response of photographic film may be implemented if the digital image is of 
film origin. Such a method is described in US Patent 5,134,573 issued July 28, 
1 992 to Goodwin, 

Next the image is balanced 44 by a transform 20 that estimates and 

25 applies balance adjustments which are required by both digital and optical 

imaging systems. This balance could for instance be obtained with an automatic 
exposure determination algorithm (such as are used in high speed optical printers 
or in a Photo-CD scanner; see for example US Patent 4,945,406 issued July 31, 
1990 to Cok). The next image transform 20 is a contrast adjustor 46 which 

30 determines and applies tonal modifications to the image. The contrast of the 

image may be estimated by an automatic algorithm. In addition, the contrast of 
the digital image may likewise be modified to a preferred level of contrast. An 



example of an algorithm that estimates image contrast and provides a means of 
adjusting the contrast of the image is described in US Patent 5,822,453 issued 
October i3, 1998 to Lee et al. 

Next, the image is rendered 48 by an image transform 20 that 
5 prepares the image to be printed onto an output media. Rendering, or mapping 
image densities to densities on the output media occurs in both digital imaging 
and optical imaging and is well known to those skilled in the art. US Patent 
6,097,470 describes image rendering. Rendering either a digital or optical image 
can, with good accuracy, be represented by a LUT (either one, three, or multi- 

10 dimensional). For example, Fig. 8a shows the graph of a LUT which relates 
image densities to densities of the output media of the output image. 

Finally, the human visual system is modeled 52 by an image 
transform 20 that models the human perception of the output image. Since the 
human visual system is less sensitive to density differences occurring in dark areas 

15 of an output image than in light areas, accounting for this difference is 

advantageous to the quantification of noise appearance in the output image. The 
human visual system perception of the image can be represented by an image 
transform LUT relating the densities of the output image to CIELAB L* values, as 
shown in Fig. 8B. 

20 Fig 9 contains several output images, all created from a common 

input image by using slightly different image processing paths 10, and the 
associated output noise tables as output by the output noise table generator 2. The 
output image shown as Fig 9A was created by application of an image processing 
path containing the following image transforms 20 (in order) : 
25 Imaging device response linearizer 42 

Balance applicator 44 
Contrast adjustor 46 
Renderer 48 

Human visual system modeler 52. 
30 As can be seen in Fig. 9A, the image produced by this processing 

path appears to be quite noisy in the high densities. The output noise table in this 



case exhibits a large peak indicating the noisy high densities. Fig. 9A contains a 
plot of the red, green, and blue output noise tables. 

The output image shown in Fig. 9B was created from the same 
input image processed by the following image transforms: 
5 Imaging device response linearizer 42 

Balance applicator 44 
Renderer 48 

Human visual system modeler 52. 

Finally, the output image shown in Fig. 9C was again created by 
10 the same input image processed by the following image transforms: 
Imaging device response linearizer 42 
Balance applicator 44 
Renderer 48 

Human visual system modeler 52. 

1 5 For the output image shown in Fig. 9C, the balance algorithm was 

forced to print the image 0.8 stops darker than recommended. This darkening in 
turn reduces the output image's graininess, which is also reflected in the output 
noise table shown in Fig. 9C. 

The output noise table output from the output noise table generator 

20 2 for each of the three output images of Figs. 9a, b and c are shown under each 
output image for each of the red, green, and blue channels. Visually, the output 
images appear to contain less noise (especially in the dark regions) from left to 
right. The output noise tables reflect this observation. 

An alternative embodiment of the output noise table generator 2 is 

25 shown in Fig. 10. In this embodiment, the output noise table generator 2 accepts 
as inputs a digital input image and an image processing path. An expanded view 
of the output noise table generator 2 of this altemative embodiment is shown in 
Fig. 1 1. In this embodiment, the input noise table may be estimated by examining 
the pixel values of the input digital image. US Patent 5,923,775 issued July 13, 

30 1999 to Snyder et al. and US Patent 5,633,51 1 issued May 27, 1997 to Lee et al. 
each describe methods by which a noise table can be created by a single (or a 
series of) digital input image(s). For this altemative embodiment, the input noise 
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table is created by such a method and then, as before, the output noise table is 
generated by processing the input noise table with a series of noise transforms 30m, 
each corresponding to an image transform 20m or the image processing path. This 
alternative is especially useful in cases where a noise table for a particular image is 
5 unknown. In addition, the accuracy of the input noise table is this embodiment 
may be superior to that of the preferred embodiment of the output noise table 
generator. However, a significant disadvantage of this embodiment is the fact that 
that is takes longer to compute. The preferred embodiment has the advantage of 
being fast to compute, and in fact the preferred embodiment may compute an 
10 output noise table considering only the input noise table, and information about the 
image processing path. Thus, the preferred embodiment has the advantage of 
computing an output noise table without analysis of the image. 



2 is shown in Fig. 12. In this embodiment, an output image (an image requiring no 
1 5 more image transforms) is directly passed to the output noise table generator 2. In 
this embodiment, the output noise table is directly estimated from the output image 
by the methods such as those described in US Patents 5,923,775 and 5,633,51 1, 
referenced previously. 



20 receives an output noise table Nm and determines from the output noise table an 
output noise metric. The output noise metric summarizes the output noise table 
Nm, such that the output noise metric is an indication of the visibility of noise on 
the output image. Note that an output noise metric can be computed for each 
spectral channel of the image, or for a combination of spectral channels. If only 

25 one output noise metric is calculated, it has been found experimentally that an 
output noise metric computed from the green channel has the highest correlation 
with observer's perception of noise appearance on an output image. An output 
noise metric computed from the blue channel has a relatively low correlation with 
observer's perception of noise appearance on an output image. In the preferred 

30 embodiment, the output noise metric N is determined with the following equation: 



A third altemative embodiment for the output noise table generator 



Referring back to Fig. 1, the output noise metric generator 4 



# • 



where the summation occurs over all intensities / and h(x) is a function. In the 
preferred embodiment, h(x) =log(A:). Referring to the images shown in Fig. 9, the 
output noise metrics computed according to the present invention for the image 
shown in Figs. 9a, 9b, and 9c are 390, 290, and 240 respectively. The noise 
5 metrics decrease along with human perception that the graininess of Fig. 9a is 
greater than the graininess of Fig. 9b, which is grainier than the image shown in 
Fig. 9c. 



where ^{x) is a function. The function g(x) may be designed, for instance, to place 
more weight on those noise levels which are large. For example, g(aM(iM)) 



metric N may be based on determining the maxinium noise level for any given 
intensity: 



If the output noise table contains noise power spectra at multiple 
20 intensity levels zm, then the functions h{x) and g{x) may be functions of intensity 
and frequency and the summation may be a two dimensional summation over 
intensity and frequency. 

Fig. 13 illustrates a use of the output noise metric. The output noise 
metric is input to an image quality determiner 26 in order that the quality of the 
25 output image created with the particular input image and image processing path 
may be estimated The image quality determiner 26 outputs an estimate of output 
image quality Q which is a function of the output noise metric. Those skilled in 
the art will recognize that the estimate of output image quality may also be 
dependent on many other attributes of the image, including the output noise metric. 




N = h ^g(.CT^{i^)) 



15 



An additional alternative method of calculating the output noise 




30 In general, Q = f(N). 



As an example, the output image quality may be estimated as Q = 
1 50 -N, where higher values of Q indicate higher levels of output image quality. 

The present invention has been described with reference to a 
preferred embodiment. Changes may be made to the preferred embodiment 
without deviating from the scope of the present invention. Such modifications to 
the preferred embodiment do not significantly deviate fi-om the scope of the 
present invention. 



PARTS LIST 

2 output noise table generator 

4 output noise metric generator 

1 0 image processing path 

1 6 noise path generator 

1 8 Noise table pre-processor 

20i (i = 1. . .m) image transform I 

22 noise path applicator 

30 i (i = 1. . .m) noise transform I 

40 noise transform generator 

42 imaging device response linearizer 

44 balance applicator 

46 contrast adjustor 

48 renderer 

52 human visual system modeler 



